# Text summarization

Pino is a Dutch pre-trained model based on the BigBird architecture, utilizing sparse attention mechanisms to handle long sequence texts, supporting sequences up to 4096 in length.

This is a Swedish GPT2-style model trained using the Flax CLM process, with training data from the Swedish portion of the wiki40b dataset.

The T5 Base Version is a text-to-text Transformer model developed by Google with 220 million parameters, supporting multilingual NLP tasks.